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Description 

[0001] This invention relates to video noise reducers and methods of noise reduction. 

[0002] A well known method for the reduction of noise in a video signal employs a recursive filter. The method op- 
s erates by averaging similar areas in successive images and relies on the fact that the true image information in a video 
signal is highly correlated. Noise, however, is generally random and is attenuated in the averaging process. A recursion 
constant k determines the relative weightings of the current and preceding frames in the averaging process and thus 
the number of frames over which effective averaging takes place. Significant attenuation of noise can be achieved with 
averaging over a relatively small number of frames. 
to [0003] It is well understood that the picture correlation upon which recursive noise reduction relies, breaks down 
where there is movement (or shot changes) in the input images. It is important to disable the recursion when movement 
is detected; failure to do this will result in image smear. Motion adaptive noise reduction has the annoying artifact, that 
picture regions at the edges of moving objects are substantially noisier than the surrounding picture, and noise increas- 
es after a shot change. An edge of a moving object is associated with disabling of recursive noise reduction so that 
is each edge of the moving object will be followed by a region of signal which is not noise reduced. The problem is 
exacerbated by the need - usually - for the motion detector signal to be filtered spatially; this results in an even larger 
area which lacks noise reduction. It is also the case that the more effective is the noise reduction process over the 
image as a whole, the more noticeable are the noisy regions around moving objects. 

[0004] It is an object of this invention to provide an improved video noise reducer and method of noise reduction 

20 which removes or reduces the above problem. 

[0005] Accordingly, the present invention consists, in one aspect, in a method of noise reduction in a video signal, 
in which pixel information is recursively filtered to produce a noise reduced output, with recursion being disabled at a 
disjuncture so that pixel information after the disjuncture is not recursively combined with pixel information prior to the 
disjuncture, wherein, after the disjuncture, recursively filtered pixel information prior to a disjuncture continues to provide 

25 the noise reduced output, until pixel information after the disjuncture has been recursively filtered to an appropriate 
degree of noise reduction. 

[0006] Advantageously, on detection of a disjuncture in the form of a shot change, from a first shot to a second shot, 
outputting of fields from the second is delayed until sufficient fields have been recursively filtered for the noise level 
on the second shot to have been reduced to approximately that of the first. 
30 [0007] Suitably, on detection of a disjuncture in the form of motion, outputting of pixels arising after the disjuncture 
is delayed until sufficient pixels have been recursively filtered for the noise level after the disjuncture to have been 
reduced to approximately that before the disjuncture. 

[0008] In a different aspect, the present invention consists in a video noise reduction filter comprising a temporal 
recursive filter; means for disabling recursion in the temporal recursive fitter on detection of a disjuncture so that pixel 
35 information after the disjuncture is not recursively combined with pixel information prior to the disjuncture; a delay path 
affording multiple filter outputs mutually delayed by picture intervals; and means for selecting between said filter outputs 
on detection of a disjuncture so that recursively filtered pixel information prior to a disjuncture continues to provide the 
noise reduced output, until pixel information after the disjuncture has been recursively filtered to an appropriate degree 
of noise reduction. 

40 [0009] The present invention recognises that, taking the example of a shot change, the visually disturbing effect of 
replacing a quiet, heavily noise-reduced shot by the first noisy field of a new shot can be avoided by delaying showing 
the new shot until sufficient fields have been recursively filtered for the noise level on the new shot to have approached 
or equalled that of the current shot. The same approach applies of course pixel-by-pixel in the face of motion. 
[001 0] The present invention will now be described by way of examples with reference to the accompanying drawings 

45 in which: - 

Figure 1 is a block diagram of a well known temporal recursive noise reduction filter; 
Figure 2 is a diagram illustrating the problem which is addressed by the present invention; and 
Figure 3 is a diagram of a noise reducer according to one embodiment of this invention. 



50 



[0011] It is convenient to describe first a temporal noise reduction filter according to the prior art. Referring to Figure 
1, a subtractor 10 serves to derive the difference between the input video signal at terminal 12 and the signal at the 
55 output 14 of the filter, delayed by one frame in delay 16. The frame difference signal which is output by the subtractor 
10 passes through a multiplier 18, the coefficient k of which is generated in noise measurement system and control 
block 20 which receives the frame difference signal as an input. In this arrangement, the rectified and filtered difference 
between the incoming signal and the frame delayed output of the filter is taken as a measure of motion. The signal 
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passing through multiplier 1 8 is added in adder 22 to the output of frame delay 1 6 to derive the filter output on terminal 1 4. 
[0012] It will be recognised that the circuit of Figure 1 serves, for each pixel, to add to the filter output in the previous 
frame, k times the difference between the current pixel and the filter output in the previous frame. In the absence of 
motion, that is to say with a small frame difference signal outputted from subtractor 10, a value is chosen for k of 

5 perhaps 0.5. The filter output in that example will comprise 50% of the current frame, 25% of the preceding frame, 
12.5% of the next preceding frame and so on. If motion is detected, that is to say the frame difference signal output 
from subtractor 10 exceeds a predetermined threshold, the value of k is set to unity. The combined effect of subtractor 
1 0 and adder 22 is then first to subtract and then to add the filter output from the preceding frame leaving only information 
from the current frame. Setting the value of k to unity accordingly disables the recursion. 

io [0013] Turning now to Figure 2, an object 50 is depicted as moving in position between frame i and frame i+1. A 
motion signal k is illustrated, being the rectified difference between frame i and frame i+1 . It will be seen that the value 
of k goes high at the leading edge of the object in frame i and falls at the leading edge of the object in frame i+1. 
Similarly, the value of k goes high at the trailing edge of the object in frame i and falls at the trailing edge of the object 
in frame It will be understood that during the intervals over which the value of k is high, the recursive noise reduction 

is is disabled. There are thus created regions in the picture at the edges of the moving object at which there is no noise 
reduction. These regions are shown for frame i+1 at a and b. 

[0014] Whist the motion signal k has been depicted as simply the rectified frame difference, it has been customary 
to filter the motion signal, causing spatial spreading. 

[0015] The relatively more noisy regions a and b in the noise reduced output of the prior art filter represent an artifact, 
20 the visual effect of which becomes more disturbing as the noise reduction and other qualities of the output image 
improve. 

[0016] It is instructive to consider the noise level in a recursive noise reduction filter and how this affects the choice 
of an optimum value of k. It has been explained that where motion is detected, k should be unity to allow the motion 
through without recursion. In stationary areas, k controls the ratio of input signal to stored signal. The optimum value 
25 depends upon the level of noise currently on the stored signal. This depends, in turn, upon the length of time since 
motion was last detected and thus the degree to which recursion has reduced noise. 

[0017] If the noise power on the input is o 5 2 and on the stored signal is o 8 2 then the noise on the output will be: 

30 of=of *k 2 + of *(1 -k) 2 

This is a minimum if: 



35 




40 In which case: 



[0018] Just after motion stops at the current point, ct s 2 = Oj 2 so k^, = 1/2 and a D 2 = Oj 2 /2. This becomes the new 
so stored signal. So on the next frame o s 2 = Oj 2 /2; k^ = 1/3 and o 0 2 = o?/3. So on successive frames the noise power 
is reduced by 1/2, 1/3, 1/4, 1/5,... etc. provided that the value of k is 1/2, 1/3, 1/4, 1/5,. ..etc. 
[0019] In preferred forms of this invention, the derivation of k embodies this approach. 
[0020] If the value of a particular pixel in successive pictures is denoted 

55 

a : b : c : d : e : 

successive outputs of a recursive filter might be:- 
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. (a+b) . (a+fr+c) . (a+b+c+<f) 
3 2 3 4 

[0021] If a disjunctive occurs between pixel values d and e, caused by motion, for example, or a shot change, 
5 recursion will be disabled and the filter output will take the form:- 

p • - (a+b+c) . (a+b+c+cf) . (e+f) . (e+f+g) 

2 3 4 2 3 

10 [0022] It will be understood that the noise level will increase significantly after: - 

(a+b+c+cf) 
4 

15 [0023] In an embodiment of this invention, the visual effect of increased noise in e is avoided by introducing a picture 
interval delay or delays and continuing to output:- 

(a+b+c+tf) 
4 

20 

until the recursive filter has produced an output following the disjuncture, which is appropriately noise reduced, for 
example :- 

(e+f+g+ti) 

25 4 

[0024] An example of a noise reducer according to the invention will now be described with reference to Figure 3. It 
will be seen that the left-hand portion of the circuit, marked "recursive section", corresponds generally to the previously 
described temporal noise reduction filter. It will accordingly not be necessary to describe again the function of subtractor 
210, multiplier 218, adder 222 and frame delay 216. In this embodiment, derivation of the signal k is performed in two 
stages. A motion detector block 250 receives the output from subtractor 210 and carries out appropriate filtering. A 
motion detection signal is then passed to one input of a motion control block 252, one function of this block being to 
provide a k signal having the properties discussed above, by which the correct proportions are maintained in the 
recursion to optimise noise reduction. To ensure that k follows this optimum sequence, the current value of> 




40 

is stored for each pixel in the frame using a loop containing frame delay 254. The motion control block 252 additionally 
derives a signal m. The function of which will be described later. 

[0025] The right-hand section of Figure 3 comprises a switched delay line giving up to three frames of delay. The 
frame delay 216 of the recursive section doubles as the first frame delay in a transversal section and there are additional 
45 frame delays 256 and 251 . Switches 260, 262 and 269 are provided to select appropriate outputs from the frame delay 
path. Switch 260 selects between the output 214 of the recursive noise reduction filter and the point 266 of the output 
from the frame delay 216. The switch 262 selects between the output of the switch 260 and the point 268 intermediate 
between frame delays 256 and 251 . Switch 269 switches between the output of switch 262 and the point 270 at the 
output of frame delay 251 . 

so [0026] The control input of switch 260 is the signal m from the motion control block 252. This signal passes through 
frame delays 272 and 274 to provide the control inputs for switches 262 and 269 respectively. 

[0027] The frame delays 216, 256 and 251 may be regarded as a picture-interval delay path affording, through the 
switches 260, 262 and 269 picture delayed outputs from the recursive filter. By suitable control of the signal m, it is 
arranged that each of the switches selects between the quietest of its two inputs. 
55 [0028] The switch 260 can choose between the output of the recursive section and its stored output. From the pre- 
vious analysis, the noise power on the output is:- 
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So m should select the stored output if:- 
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o 2 0 = of*k 2 + o 2 s -(1-kf 



2 2. ,2 2„„ ..2 

o $ < o,- *k + o s *(1 -k) 



This condition reduces to:- 

■a 



[0029] In practice the value of k (generated by analysis of the motion) will pass very rapidly between ko pt and unity. 
So the exact threshold is not critical. 

[0030] The next switch can choose between the previous delayed output, and the output of the first switch. If the first 
20 switch is currently selecting the stored output, then the second switch is offered delayed versions of the signals offered 
to the first switch, and so it can use a delayed version of the same decision (m). On the other hand, if the first is currently 
selecting the nondelayed output (because it is quieter than the delayed output) then the second switch should ideally 
remake the decision using a lower threshold. However, since the threshold is not really critical, satisfactory results are 
v obtained by simply using the original decision (m) delayed by one frame in both cases. Similarly, subsequent switches 
25 can also be controlled by delayed versions of m. The slight error introduced by this simplification can be reduced on 
average by using a slightly lower threshold to generate m. 

[0031] The motion control block can be implemented in many ways. The simplest is probably a PROM containing 
pre-computed output values for all combinations of its inputs. 

[0032] To clarify the operation of the circuit, the previous notation will be employed of successive pixel values a, b, 
30 c, d... separated by a picture interval, with a disjuncture such as a shot change occurring between d and e. The signal 
appearing at critical locations are shown in the following table:- 
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[0033] It will be seen that when the value e appears at the input of the filter, the previously noise reduced value: - 

a+b+c+d 
4 

is continued to be output until a further three values f, g, h have been received at the input enabling recursive noise 
reduction following the disjuncture to create a value which has the same noise value: - 

e+f+g+h 
4 
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[0034] It should be understood that the described arrangement of delays and switches is but one example of how 
choices can be made between delayed outputs of the recursive filter to select outputs having minimum noise. More 
generally, this invention has been described by way of examples only and a wide variety of possible modifications are 
possible without departing from the scope of the invention. 



Claims 

1. A method of noise reduction in a video signal, in which pixel information is recursively filtered to produce a noise 
reduced output, with recursion being disabled at a disjuncture so that pixel information after the disjuncture is not 
recursively combined with pixel information prior to the disjuncture, wherein, after the disjuncture, recursively fil- 
tered pixel information prior to a disjuncture continues to provide the noise reduced output, until pixel information 
after the disjuncture has been recursively filtered to an appropriate degree of noise reduction. 

2. A method according to Claim 1 , wherein the output of a recursive filter is presented to a picture interval delay chain 
and, following detection of a disjuncture and disabling of recursion, a selection is made between picture interval 
delayed filter outputs. 

3. A method according to Claim 1 or Claim 2, wherein on detection of a disjuncture in the form of a shot change, from 
a first shot to a second shot, outputting of fields from the second shot is delayed until sufficient fields have been 
recursively filtered for the noise level on the second shot to have been reduced to approximately that of the first. 

4. A method according to Claim 1 or Claim 2, wherein on detection of a disjuncture in the form of motion, outputting 
of pixels arising after the disjuncture is delayed until sufficient pixels have been recursively filtered for the noise 
level after the disjuncture to have been reduced to approximately that before the disjuncture. 

5. A method according to any one of the preceding claims, wherein the recursion is controlled after a disjuncture 
such that available pixels contribute equally to the filter output. 

6. A method according to Claim 5, in which the recursion constant is varied in dependence upon the count of picture 
intervals since a disjuncture leading to disabling of recursion. 

7. A method according to any one of Claims 1 to 4, wherein the recursion constant is varied after a disjuncture in 
dependence upon the count of picture intervals since the disjuncture, to minimise the output noise level. 

8. A video noise reduction filter comprising a temporal recursive filter; means for disabling recursion in the temporal 
recursive filter on detection of a disjuncture so that pixel information after the disjuncture is not recursively combined 
with pixel information prior to the disjuncture; a delay path affording multiple filter outputs mutually delayed by 
picture intervals; and means for selecting between said filter outputs on detection of a disjuncture so that recursively 
filtered pixel information prior to a disjuncture continues to provide the noise reduced output, until pixel information 
after the disjuncture has been recursively filtered to an appropriate degree of noise reduction. 

9: A video noise reduction filter according to Claim 8, wherein the means for selecting between multiple filter outputs 
serves to select the output having the minimum noise level. 



Patentanspruche 

1. Verfahren zur Rausch- bzw. Storungsverminderung in einem Videosignal, bei dem PixeMnformationen rekursiv 
bzw. wiederholbar gefiltert werden, um einen storungs- bzw. rauschreduzierten Ausgang zu erzeugen, wobei die 
Rekursion bei einer Unterbrechung gesperrt wird, so dass Pixel- bzw. Bildelementinformationen nach der Unter- 
brechung nicht rekursiv bzw. wiederholbar mit Pixel- bzw. Bildinformationen vor der Unterbrechung kombiniert 
werden, wobei nach der Unterbrechung rekursiv gefilterte Pixel- bzw. Bildelementinformationen vor einer Unter- 
brechung fortfahren, den rausch- bzw. storungsreduzierten Ausgang zur Verfugung zu stellen, bis Pixel- bzw. 
Bildinformationen nach der Unterbrechung rekursiv bis zu einem passenden bzw. geeigneten Grad der Rausch- 
bzw. Storungsverringerung gefiltert worden sind. 

2. Verfahren nach Anspruch 1, wobei der Ausgang eines rekursiven Filters an eine Bildintervalrverzogerungskette 
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angelegt wird und der Erfassung einer Unterbrechung unter Sperrung der Rekursion folgend eine Auswahl zwi- 
schen bildintervallverzogerten Filterausgangen durchgefuhrt wird. 

3. Verfahren nach einem der Anspruche 1 oder 2, wobei bei der Erfassung einer Unterbrechung in der Form eines 
5 Bildwechsels von einem ersten Bild zu einem zweiten Bild die Ausgabe von Feldem von dem zweiten Bild verzogert 

wird, bis ausreichend Felder rekursiv gefiltert worden sind, um den Storungs- bzw. Rauschpegel auf dem zweiten 
Bild rekursiv naherungsweise auf den des ersten reduziert zu haben. 

4. Verfahren nach einem der Anspruche 1 oder 2, wobei bei der Erfassung einer Unterbrechung in der Form einer 
10 Bewegung die Ausgabe von Pixeln bzw. Bildelementen, die nach der Unterbrechung erscheinen, verzogert wird, 

bis ausreichend Pixel bzw. Bitdelemente rekursiv gefiltert worden sind, um den Storungs- bzw. Rauschpegel nach 
der Unterbrechung auf naherungsweise den vor der Unterbrechung reduziert zu haben. 

5. Verfahren nach einem der vorangehenden Anspruche, wobei die Rekursion so nach einer Unterbrechung gesteuert 
is wird, dass verfugbare Pixel bzw. Bitdelemente gleichermassen zu dem Filterausgang beitragen. 

6. Verfahren nach Anspruch 5, in dem die Rekursionskonstante in Abhangigkert von der Zahl der Bildintervalle seit 
einer Unterbrechung verandert wird, was zu einer Sperrung der Rekursion fuhrt. 

20 7. Verfahren nach einem der Anspruche 1 bis 4, wobei die Rekursionskonstante nach einer Unterbrechung in Ab- 
hangigkeit von der Zahl der Bildintervalle seit der Unterbrechung verandert wird, um den Ausgangsrausch- bzw. 
-Storungspegel zu minimieren. 

8. Videorausch bzw. -Storungsverringerungsfilter, der aufweist, einen temporaren Rekursionsfilter; Mittel zum Sper- 
25 ren der Rekursion in dem temporaren Rekursionsfilter bei Erfassung einer Unterbrechung, so dass Pixel- bzw. 

Bildelementinformationen nach der Unterbrechung nicht mit Pixel- bzw. Bildelementinformationen vor der Unter- 
brechung rekursiv kombiniert werden; einen Verzogerungspfad, der mehrere Filterausgange aufbringt, die gegen- 
seitig um Bildintervalle verzogert sind; und Mittel, um zwischen den Filterausgangen bei Erfassung einer Unter- 
brechung auszuwahlen, so dass rekursiv gefilterte Pixel- bzw. Bildelementinformationen vor einer Unterbrechung 
30 fortfahren, einen storungs- bzw. rauschverringerten Ausgang zur Verf ugung zu stellen, bis Bildelementinformatio- 

nen nach der Unterbrechung rekursiv bis zu einem passenden bzw. angemessenen Grad der Storungs- bzw. 
Rauschverringerung gefiltert worden sind. 

9. Videorausch- bzw. Storungsverringerungsfilter gemaG Anspruch 8, wobei die Mittel zum Auswahlen zwischen 
35 mehreren Filterausgangen dazu dienen, den Ausgang auszuwahlen, der den minimalen Storungs- bzw. Rausch- 
pegel hat. 



Revendications 

40 

1. Precede de reduction de bruit dans un signal video, dans lequel des informations de pixel sont filtrees recursive- 
ment pour produire une sortie a bruit red u it, la recursion etant invalidee a la disjonction pour que des informations 
de pixel apres la disjonction ne soient pas recursivement combinees avec des informations de pixel avant la dis- 
jonction, ou, apres la disjonction, des informations de pixel filtrees recursivement avant une disjonction continuent 
45 a fournir une sortie de bruit reduit, jusqu'a ce que les informations de pixel apres la disjonction aient ete filtrees 

recursivement a un degre de reduction de bruit approprie. 



2. Precede selon la revendication 1 , dans lequel la sortie d'un filtre recurs if est presentee a une chalne de retard 
d'intervalle d'image et, apres detection d'une disjonction et invalidation de la recursion, une selection est effectuee 

50 entre des sorties de filtre retardees d'intervalle d'image. 

3. Proced6 selon la revendication 1 ou la revendication 2, dans lequel sur detection d'une disjonction sous la forme 
d'un changement de prise de vue, d'une premiere prise de vue a une seconde prise de vue, la fourniture des 
trames de la seconde prise de vue est retardee jusqu'a ce que des frames suffisantes aient ete filtrees recursive- 

55 ment pour que le niveau de bruit de ia seconde prise de vue ait ete reduit approximativement a celui de la premiere. 

4. Precede selon la revendication 1 ou la revendication 2, ou sur detection d'une disjonction sous la forme de mou- 
vement, la fourniture des pixels se produisant apres que la disjonction a ete retardee jusqu'a ce que suffisamment 
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de pixels aient ete filtres recursivement pour que le niveau de bruit apres la disjonction ait ete reduit approxima- 
trvement a celui avant la disjonction. 

5. Procede selon Tune quelconque des revendications precedentes, dans lequel la reduction est. commandee apres 
s une disjonction pour que des pixels disponibies contribuent egaiement a la sortie de filtre. 

6. Procede selon la revendication 5, dans lequel la constante de reduction varie en fonction du comptage des inter- 
valles d'image depuis une disjonction conduisant a une invalidation de la recursion. 

io 7. Procede selon Tune quelconque des revendications 1 a 4, dans lequel la constante de reduction varie apres une 
disjonction en fonction du comptage des intervalles de pixels depuis la disjonction, pour minimiser le niveau de 
bruit de sortie. 

8. Filtre de reduction de bruit video comprenant un filtre recursif temporel ; un moyen pour invalider une recursion 
15 dans le filtre recursif temporel a la detection d'une disjonction pour que des informations de pixel apres la disjonction 

ne soient pas recursivement combinees avec des informations de pixel avant la disjonction ; un chemin de retard 
offrant de multiples sorties de filtre mutuellement retardees par des intervalles d'image ; et un moyen pour selec- 
tionner entre lesdites sorties de filtre lors de la detection d'une disjonction de sorte que des informations de pixel 
filtrees recursivement avant une disjonction continuent a foumir la sortie reduite de bruit, jusqu'a ce que les infor- 
20 mations de pixel apres la disjonction aient ete recursivement filtrees a un degre de reduction de bruit approprie. 

9. Filtre de reduction de bruit video selon la revendication 8, dans lequel le moyen pour selectionner entre des mul- 
tiples sorties de filtre sert a selectionner la sortie ayant le niveau de bruit minimum. 

25 
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